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ABSTRACT 

A statewide goal priority instrument was validated. 
Public hearings were held, the results summarized by citizens, and. an 
instrument constructed on this summary. The instrument design was 
that of stance and Cooler, which suggests importcint variations in 
respondent publics, the scales employed, and the specificity of the 
statements. These variations were confirmed. A diverse group of 
respondents was interviewed. The validity of the instrument was 
deemed to be high except that it did not detect an underlying 
dissatisfaction. Technical and substantive results of the field test 
are discussed. Caution is suggested in gathering data from the 
general public. (Author) 
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S ummary of Study 

Organizations typically become impermeable to new or critical information, espe- 
cially at the top management level. This problem may be attacked by systematically 
collecting and analyzing the opinions of client publics about organisational goals, 
programs, and image. This study developed and field tested such a procedure. 

The content of the procedure was drawn from Action Goals for the Seventies: An 
Agenda for Illinois Education , a summary of the outcomes of the OSPI public 
hearings* The measurement techniques were drawn from CIRCE *s latest research on 
goal priorities. This research suggests that various publics* responses to goal 
statements depend on the specificity of the goals and the type of scales used. 
These assumptions were verified when the instrument was field tested on a group 
of forty citizens of diverse backgrounds in a medium-sized Illinois city. 

The field test showed that mastering basic skills and providing equal educational 
opportunity were the most important goals for the total group. Providing oppor- 
tunities for training in the world of work and for expressing creativity were 
least important. On the other hand, respondents thought most of the available 
money should be spent on mastering basic skills, providing equal educational 
opportunity and on providing opportunities for training in the world of vjork 
v;bile not much money should be spent on anything else. 

Within the response totals lie interesting differences among the three groups 
analyzed — students, school personnel, and citizen-parents. For example, students 
saw expression of creativity as more important that the other groups did and 
would spend more money on adapting to a changing world — a goal school personnel 
do not value highly. Overall, the respondents thougat students having the chance 
to express creativity and to develop a positive attitude toward learning were 
least likely to occur. 

On specific OSPI programs, respondents allocated most resources to equal educa- 
tional opportunity and statewide student assessment, with drug abuse and career 
education tied for third. Least state effort was allocated to school reorganiza- 
tion and student rights. 

Nhat did respondrats think of the OSPI itself? The most negative opinions were 
that the OSPI does not allow all people to participate in governance nor does it 
have everyone's support. School personnel were especially negative. The best 
features of the OSPI were its qualified leadership and qualified personnel. It 
is most in need of improvement in obtaining public support and in maintaining 
effective contact with local, regional, and other state agencies. 

The technical results of the field test are discussed, and the instrument is 
revised on the basis of the technical results. Conditions under which the 
instrument should be used are discussed, including sampling schemes, analysis-of- 
data techniques, and the limitations of the Instrument. The main limitation is 
in domains the instrument does not tap, namely respondents' deep-seated and 
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underlying hostilities toward institutions. Procedures for strengthening these 
weaknesses are discussed. Three basic plans for employing these techniques with 
accompanying cost estimates are presented. Finally, some suggestions for further 
development are spelled out, such as collecting the data through the PLATO com- 
puter terminals to be installed throughout the state. 



There is increasing awareness in educational*-policy circles of the necessity of 
ascertaining the opinions o.: significant reference groups if any real changes in 
current educational structures are to occiir. Knowledge of the opinions of various 
client publics is also essential in formulating policy. In Illinois some studies 
of educational goals acd priorities have already been undertaken, such as Title III 
needs assessments and the public hearings held throughout the state by the OSPI. 
However, educational goals and priorities change. 

For some time Stake (1970) has advocated treating objectives and priorities as 
empirical data rather than as "givens." Carefully treated, such data might be 
used over time as indicators of educational trends. For example, the University 
of Michigan has been able to predict significant shifts in the national economy 
by surveys of the American consumer. While such an achievement is unrealistic if 
resources are limited, monitoring beliefs about the OSPI in particular and educa- 
tion in general might help the OSPI become more effective as an education insti- 
tution. 

Organizational theory confirms the wisdom of such an approach. In a recent study 
of organizational innovativeness, Nbrmann (1971) distinguished between the primary 

environment of the organization — the organizational 'domain'* and the secondary 

environment (Figure 1). 



Why It Should Be Done 



Figure 1. Perception of Environmental Stimuli 
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Because of the constant interaction among people in the organizational domain, it 
is easy for the organization to perceive and interpret events. But for events 
outside the domain there are no appropriate rules for attention and decoding. 
Major changes in an organization require a change of domain. The existing cogni- 
tive structure (attention rules, decision rules, interpretation rules, etc.) is 
simply insufficient. New goals, values, and power structures are needed. On the 
other hand, minor changes can be accommodated within the existing domain. To a 
considerable extent, then, organization innovativeness is accompanied by changes 
in the organizational domain. 

There is at least one major danger: When stimuli are received from outside the 
normal domain, the organization has no way of checking their validity. In othei 
TOrds, the perception is mediated rather than direct. It is possible for the 
organization to receive bad information from this mediating source without knowing 
it. For example, one small drug company was induced by its pharmacologists to 
develop new products for which there was no market. 

Another way to conceive of organizational behavior is in terms of an organizational 
Image. Though images exist only in the minds of individuals, in a sense there is 
also an organizational image-— it is the collectivity of Images held by organiza- 
tional members. This composite image.- is not just a simple sum of all the Images 
of all the individuals within the organization since the image of the chief execu- 
tive obviously has considerably more impact on the future behavior of the organi- 
zation than that of members lower in the hierarchy. On the other hand, it is 
precisely through communicating his own image to the other organizational members 
that the executive makes the organization respond to his intents. 

Furthermore, each department within a large organization has .i separate image 
which has some similarity to the general organizational image. In fact, each 
department is a cohesive group to the degree it shares a comEron image. Numerous 
works on bureaucratic organizations have contended that the 5;ubgroup structure in 
a given organization generates intense in-group feelings and the loyalty to this 
section and to the section chief can become a paramount consideration. Conformity 
to the regulations becomes the end in itself. Deviation from accepted procedures 
is dangerous and the result is the unacceptability of any manner of behavior other 
than that being pursued. This leads to the %onocratic stereotype." No conflict 
and no divergent ideas are allowed within the structure. Hence, even alternate 
ways of solving problems ^ire suppressed. In fact, the most difficult thing for 
an organization to do is ^:o generate an alternative way of doing things. 

To the degree the organiKatlon is isolated and all lines of communication lie 
within it, the organizational image is self-perpetuating. The messages received 
are always confirmatory as they originate from essentially the same image. The 
net result is that any information received by the organization is not likely to 
change the organization's image. The organizational self-image remains intact and 
the organization pursues only goals defined in that image. Thus the organization 
becomes Increasingly inward-^looking and farther and farther removed from the con- 
siderations of its clients. This alienation is a natural and progressive process. 
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Instrumenj DeveJopiient 

The Ratlomile 

What type of data collection would best suit the demands of the situation? It was 
assumed from the beginning that t^e method would have to be inexpensive, easy to 
administer, and easy to interpret. These requirements indicated a survey either 
by interview or by questionnaire* Consideration, that the instrument might be used 
to fulfill federal reporting requirenents led to the questionnaire choice, some 
limitations of which will be described later. 

I'Jbat should the questionnaire contain? This was the easiest of all questions to 
answer. The OSPI had held hearings throughout the state in an atteir^)t to determine 
state educational goals. Those were collated and explicated by a citizens commit- 
tee and the OSPI in a document entitled Action Goals for t.ae 1970's; An A ^^ endg 
for Illinois Educatio n. Within the state office this document had assumed an 
unchallenged authority. The validity of the content of the questionnaire was 
established by basing it on this document which had been compiled by public testi- 
mony, assembled by a citizens group, and accepted by the OSPI. 

What form should the questionnaire take? The leading work on this point has been 
done by Cooler and Stake at CIKCE in Strategies for Obtaining Clarification in 
Educational Priorities (Cooler, 1971), "Objectives, Priorities, and Other Judgment 
Data," (Stake, 1970), and "Measuring Educational Priorities," (Stake and Cooler, 
1S71). The essence of this research is presented In Figure 2. 

This design suggests that significant differences in priorities may occur among 
such groups as citizens, teachers, etc.; that priorities will vary depending on 
whether the goals are stated as broad aims, course content, or behavioral objec- 
tives; that they will vary depending on whether the scale indicates importance, 
time allotment, cash allotment, etc.; and that they will vary depending on 
whether they are "real" or ideal. 

Stake and Cooler suggest that data be collected within all of these cells.. Since 
this would result in a very long instrument, only the most important goals 
treated with varying scales were included in our instrument. Their ideas were 
further modified for this study by substituting the concept of "feasibility" for 
that of "real." Rather than asking whether certain goals were being achieved, 
It was decided to ask for the likelihood of achievement. It is conceivable that 
one might hold a goal highly desirabxe yet think it cannot be pursued successfully. 

Part lA of the instrument listed the nine major specific goals from Action Goals 
for the 1970 's and asked for rating in terms of Importance. Part IB presented 
the same goals and asked for likelihood of accomplishment. Part IC presented 
the same goals and asked how much money should be spent on them. Different 
scales were used on the same goal set to emphasize the difference in the questions 
being asked and to break up the response set of the respondent. 
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Figure 2 
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Part II asked for allocation of percent of OSPI effort across ten programs the 
OSPI is currently pursuing. Listing the programs required reducing many pages 
into one sentence. This was the most difficult material to condense. The programs 
were Intentionally presented in ten parts so respondents could use deciles In 
responding. 

Part ];il did not as? for a goal-priority response. Rather, it listed character- 
istics of the OSPI deemed necessary for it to obtain its goals and asked respowt - 
ents CO register thair opinion on whether the OSPI currently had that trait. \'a 
other words, this wis an atteo^t to uncover the image of the OSPI itself as 
perceived by various publics. 

The last part of the instrument was taken directly from Cooler's dissertation and 
not from the OSPI document. It asks the respondent to choose among three major 
purposes of education: the hunan purpose, the knowledge purpose, and the career 
purpose. 

The instrument underwent several revisions and was reviewed by several people 
befoie being field tested. A copy, including the tally from the field tests, is 
presc^nted below. 



The Instrument 

WHICH EDUCATIONAL PRIORITIES FOR YOUR STATE? 

During 1971 the Office of the Superintendent of lie Instruction (OSPI) 
held a number of public hearings throughout Illinois to ask its citizens what the 
future of education in the state should be. Many ideas emerged from these hearings, 
Not all of them can be pursued with equal vigor, however, because resources are 
always limited. Your answers to the questions in this booklet will help tell us 
which ideas should be pursued the most and how OSPI can better help achieve them. 
This is an opportunity for you to have a direct influence on the education of the 
children in your state. 

To which group, or groups, do you belong? 

School Superintendent Parent of School Child 

School Principal Legislator 

Teacher Citizen 

Student Other 

School Board Member 
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I. Goals 

A. How Important is it for the Office, of the Superintendeat ol: Public Instruc- 
tion to pursu^i these goals? (Please indicate by checkins one box in each row.) 



This is a goal which should be 



Quite Not Partic- Very Absolutely 
unimp^r tant ularly important vital 
important 



1. 


Students should toaster the 
basic skills of rpAdine 
communication » computation » 
and problem soli/ing 





1 

2 


17 


1 

21 


2. 


Students should demonstrate 
a puoxi.xvc ai.i.ii.uQe towaru 
learning 




S 


23 


11 


3. 


Students should demonstrate 
self -worth 




5 


24 


10 


A. . 


Students should be given 

kilts x.&c«:uuiu 6Xpt6SS tns 

full extent of their 
creativity 


2 


8 


19 


11 


5. 


Students should acquire 

^V9A.i.A.Vw eft i« i«X i«UUCa l>UWCfttU 

persons and cultures 
different from their own 




8 


25 


6 


6. 


Students should have equal 
educational opportunities 


1 


1 


19 


17 


7. 


Students should receive 
opportunity in training 
for the world of work 


4 


8 


18 


9 


8. 


Students should have 
experience in adapting 
to a changing world 




10 


18 


11 


9. 


Students should acquire 
habits and attitudes of 
good citizenship 


2 


5 


19 


13 

1 
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B. What is the likelihood that each of thes^i goals will be achieved? (PleAse 
indicate by placing an "X*' along the lim.) 
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3 


19 
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for the world of work 
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1 . 


8. 


Students should have 






















experience in adapting 
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20 
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to a changing world 
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9. Students should acquire 
habits and attitudes of 
good citizenship 



17 
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C. Bov fliuch nonty should the Office of th' Superintendent of Public Instructio i 
(OS;PI) apend on each of these goals? Please indicate by checking one box 
in each row.) 

The OSPI should spend 





No money 


Little money 


Quite a lot 
of money 


As auch a» le; 
ae possible 


1. Students should master | 
th<i basic skj.lls of 
residing » coiBtunlcatlon» 
cO)^fiputation» and problem 
solving. 




4 


13 


1 

22 

4 


2. StJdents sho ild dcnonr 
strata a positive attl«* 
tude tovard Learning 


3 


14 


16 


6 


3. Students shoild deBon** 
ttrate a feeling of 
e.equacy an(^ self^vorth 


6 


12 


13 


6 


A. SUiidents shtuld be 
given the freedom to 
express the full extent 
of their crmivlty 


1 


18 


15 


5 


5. Students should acquire 
positive attitudes toward 
persons and cultures 
different irom their own 


1 


20 


15 


3 


6. Students should have 
equal educational 
opportunities 


1 


3 


19 


16 


7. Students should receive 
opportunity in training 
for the world of work 


1 


8 


19 


12 


8. Students should have 
experience in adapting 
to a changing world 


2 


16 


15 


6 


9. Students should acquire 
habits and attitudes of 
good cititenship 


2 


16 


14 


7 

1 
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Programs 

Below are the goals of programs that have actually begun. How much of the 
current total efforts of the Superintendent of Public Instruction (OSPI) 
should be expended on each one? (Roughly estimate percent of state effort, 
by tens if convenient.) 



% of Total Effort 



1. The assessment of student achievement, attitudes, 

and needs throughout the state. 1A% 

2. The provision of equal educational opportunities for 
all students regardless of their racial or cultural 
origins or handicaps by eliminating all patterns of 
segregation and by providing programs and services. 18% 

3. Increased public participation in school decision- 
making through public hearings, student reprer: sta- 
tion, appeal procedures, citizen advisory councils, 

etc. 8% 



4. The reorganization of school districts so each 

district will have sufficient size and resources. 5% 

5. The reorganization of pre-kindergarten education 

and individualized instruction in local schools. 7% 

6. The incorporation of drug abuse education in local 

schools. 12% 



7. The establishment of career education and adult 

education programs. 12% 

8. The adjustment of professional preparation, certi- 
fication, and retraining procedures. 8% 

9. The Improvement of pupil services such as school 

counselors, psychologists, and social workers. 10% 

10. The adoption of a statewide policy of student rights. 6% 



TOTAL 100% 



111. Current Status of OSPI 



A. In order to facilitate reaching these goals for the State's children, 
the Office of the Superintendent of Public Instruction (OSPI) feels that 
it should possess certain qualities. These qualities are listed below. 
Please indicate the extent of your agreement with the assertion that the 
Office of the Superintendent of Public Instruction now possesses each of 
these qualities. 







Strongly 
Disagree 


Disagree 


No 
Opinion 


Agree 


Strongly 
Agree 


1. 


Is accountable to tne citizens 
of the state 




7 


13 


12 


5 


2. 


Is flexible, adaptive, and 
open 


1 


4 


19 


14 


1 


3. 


Is relevant for the times 


1 


8 


14 


16 


1 


4. 


Provides for equal educational 
opportunity 




5 


11 


20 


1 


5. 


Encourages new developments 




5 


10 


20 


3 


6. 


Is humanistic 




3 


20 


12 


3 


7. 


Adapts to important changes 




6 


16 


10 


5 


8. 


Provides for continuous 
training and retraining of 
professional educators 




5 


13 


19 


2 


9. 


Allows all people to partic- 
ipate in governance 


2 


13 


20 


4 




10. 


Has sufficient financial 
support 


1 


7 


18 


11 


1 


11. 


Has qualified personnel 






15 


17 


5 
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Strongly 



No 



Strongly 



12. Has qualified leadership 



13. Has everyone's support 



14. Has sound Information basis 
for decision-making 



15. Is sensitive to state, 
regional and local needs 



16. Maintains effective contact 
with local, regional, and 
state agencies 

17. Encourages coordinated 
efforts among local, regional 
and state agencies 

18. Has sufticient 'Venture 
capital" to support new 
educational practices 





1 


16 


16 


1 

4 


5 


21 


9 


2 


1 




5 


19 


10 


2 




8 


12 


16 


1 




6 


17 


13 


1 




3 


18 


15 


1 


■ 1 • 


20 


5 





B. In which three of these qualities does the OSPI most need Improvement? 
(Write the number of the quality in the space below.) 

1. number 13 

2. number 16 



3« number 1 & 10 



1. 


8 


10. 


8 


2. 


6 


11. 


2 


3. 


4 


12. 


3 


4. 


6 


13. 


13 


5. 


3 


14. 


2 


6. 


2 


15. 


6 


7. 


0 


16. 


9 


8. 


7 


17. 


3 


9. 


6 


18. 


5 
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The Field Test 



Validation of Instrument 



Two basic procedures were considered for the field test. The traditional method 
is to administer the instrument to a fairly sizable sample and to analyze the 
responses and distribution of responses to each item. The second way is to admin- 
ister the instrument to a known group of people and see if they respond as one 
would expect them to. The second way was chosen because interviewing a small 
nimiber of people was thought to produce better instruments; because a CIRCE staff 
member had been doing a two-year on-site study and a known population was readily 
available; and because the validity of needs assessment instruments, particularly 
their language » was challenged within CIRCE. 

A highly varied sample of people were taken from a medium-sized Illinois city, 
all of whom were known personally. A sample of the variety of respondents can be 
gained from a partial list: 



High school librarian/ 
teacher negotiator 

Curriculum director 

Daughter of curriculum 
director 

Housewife/ saleswoman 

Math teacher 

Elementary principal 

Widow 

Grocer 

Bank Clerk 

High School student 



Businessman 
University drop-out 
Radio station 

manager 
Service station 

owner 
Farm wife 
School clerical 

assistant 
ADC (Aid to Dependent 

Children) mother 
Teacher 

School board member/ 
construction worker 



Teacher/principal 
Funeral director 
Bank vice-president 
School board member 
Farmer 

High School drop-out 
Telephone lineman 
Factory worker 
Invalid ex-sheriff 
Junior high school student 
Factory foreman 
University student 



Kineteen people filled oui: the Instrument and returned it without any help. 
IVenty people were Interviewed as they filled out the Instrument. Eleven more 
were Interviewed in two groups. The interviews were Informal. They stressed any 
difficulties which the respondents might have had in filling out the instrument and 
ideas that the instrument may have generated. 

Substantive Results 

Analysis of the forty completed copies of the instrument yields numerous observa- 
tions about the respondents* feelings towards educational goals and programs, the 
OSPI, and the purpose of education. These observations are intuitive and are not 
derived from the formal analysis suggested in the "Conditions of Use" section. 

Goals * When responses of all persons completing the instrument are considered 
together, the following observations can be made about the Importance of the goals: 
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1. All nine goals are either 'Very important*' or "absolutely vital." 

2. Goal 1 (mastering basic skills) and Goal 6' (having equal educa- 
tional opportunities) are most important. 

3. Goal 7 (having the opportunity for training for the world of 
work) and Goal 4 (having the freedom to fully express their 
creativity) are least Important. 

There are noteworthy variations in the response tendencies when responses of the 
three groups completing the questionnaire (students, school personnel, and citizens 
and parents) are considered separately. These variations include the following: 

1. Students think Goal 1 (mastering basic skills). Goal 7 (having the 
opportunity for training for the world of work), and Goal 9 (devel- 
oping good citizenship) are less important than do school personnel 
and citizens and parents. 

2. Students think Goal 4 (having the freedom to fully express their 
creativity) is more Important than do either of the other groups 
though school personnel think it is more Important than do citi- 
zens and parents. 

3. Citizens and parents feel Goal 2 (demonstrating a positive attitude 
toward learning) is more important than the other groups do. 

4. School personnel think Goal 8 (having experience adapting to a 
changing world) is less Important than the others do. 

A great variety of opinion exists about the likelihood of any of the nine goals 

being achieved. However, a majority of the total number of respondents feel it 

Is likely that each goal will be achieved. Particularly positive or negative 
response tendencies include the following: 

1. More people are "certain" that Goal 6 (having equal educational 
opportunities) will be achieved than any of the other goals 
although opinion is quite divided on the subject. Students are 
most optimistic, school personnel are least so. 

2. All but one respondent feels that Goal 1 (mastering basic 
skills) will be accoiq>lished . More respondents feel it is 
"highly likely" that this goal will be achieved than any other 
goal. 

3. Least likely to be achieved is Goal 4 (having the freedom to 
express fully their creativity) though students feel it is 
more likely that this goal will be achieved than school person- 
nel or citizens and parents do. 
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4. Respondents are rather pessimistic about Goal 2 (demonstrating 
a positive attitude toward learning) being accomplished, espe- 
cially school personnel, 

5. Students are slightly less optimistic than the other respond- 
ents that Goal 8 (having experience adapting to a changing 
world) will be accomplished* 

Respondents feel the most money should be allocated to help achieve three goals: 
Goal 1 (mastering basic skills) » Goal 6 (having equal educational opportunities), 
and Goal 7 (having the opportunity for training for the world of work). Citizens 
and parents want to spend a lot of c^oney on all three of these goals. School 
personnel support spending to achieve Goal 1 more than students or citizens and 
parents do while students support spending for Goal 6 and Goal 7 less than the 
other groups do. Almost half of the respondents (over half for Goal 5) said 
little or no money should be spent on the other goals. 

Some interesting variations in their ideas about how the money should be spent 
exist among the three groups* 

1. School personnel strongly support spending for Goal 2 (demon- 
strating a positive attitude toward learning) and Goal 3 
(demonstrating a feeling of adequacy and self-wor.h) while 
students and citizens and parents do not* 

1. Students feel little money should be spent on Goal 9 

(developing good citizenship) compared to the other groups* 

3. Students would like "quite a lot'' of money spent on Goal 8 
(having experience adapting to a changing world) i^ile the 
other groups generally feel a "little" would be sufficient* 

4« Citizens and parents think less money should be spent on 

Goal 4 (having the freedom to express fully their creativity) 
and Goal S (acquiring positive attitudes towards other persons 
and cultures) than do students or school personnel. 

When respondents* feelings about the importance of the goals » the likelihood of 
their being accomplished » and the allocation of money to help achieve them are 
combined » one can conclude that respondents believe Goal 1 (mastering basic skills) 
should receive top priority^ closely followed by Goal 6 (having equal educational 
opportunities). Respondents indicated that both of these goals are *Very Important" 
or "absolutely vital/' that it is highly likely they will be achieved (though 
opinion about Goal 6 was more divided on this point) » and that much money should be 
allocated to help achieve them. They are definitely top priority. Other priorities 
or preferences are less obvious when considering all three variables (Importance » 
likelihood of achievement » money allocation). However » additional priorities 
could be established based on i:ll three variables—or only on one or two of them — 
depending on what is desired. 



Programs . The five main programs on which respondents think the OSPI should con- 
centrate its efforts are the following: 

!• Providing equal educational opportunities (Program 2) is clearly 
the most important program. Respondents think it should receive 
more support than any of the other programs, approximately 187 
of the OSPI effort. However, citizens and parents believe this 
program should receive slightly less effort than students or 
school personnel do. 

2« Statewide student assessment (Program 1) is second in Importance; 
it should receive 14Z of the OSPI effort. It has the support of 
all three groups. Citizens and parents think this program should 
receive the same amount of effort as Program 2 (equal educational 
opportunities) and Program 6 (drug-abuse education). School 
personnel think an equal amount of effort should go to Program 7 
(career and adult education) and to Program 9 (pupil services). 

3. Program 6 (drug-abuse education) and Program 7 (career and adult 
education) should each receive 12Z of the OSPI effort. Citizens 
and parents particularly favor Program 6; school personnel support 
Program 7 more than the others do. 

4. Liproving pupil services (Program 9) should receive lOZ of the 
OSPI effort. This program is supported by the school personnel 
and citizens and parents; students prefer Program 3 (increased 
public participation in school decision-making). 

Current Status of the OSPI . Though many respondents indicate "No Opinion," more 
respondents agree than disagree with the assertions that the OSPI does possess each 
of the desired qualities, with three exceptions. Of those expressing an opinion, 
the majority of respondents disagree with assertion 9 (the OSPI allows all people 
to participate in governance), assertion 13 (the OSPI has everyone^s support), and 
assertion 18 (the OSPI has sufficient 'Venture capital" to support new educational 
practices). All school personnel expressing an opinion disagree with assertion 9, 
and all school persorael disagree with assertion 13. Agreement is most strong 
with assertions 11 and 12 (the OSPI has qualified personnel and the OSPI has qual- 
ified leadership). 

Analysis of the opinions of each group yields several other noteworthy observations 

1. School personnel are more inclined to believe the OSPI is not 
relevant for the times (assertion 3) than students or citizens 
and parents are. 

2. Most school personnel indicate "No Opinion" about assertion 7 
(the OSPI adapts to Important changes), a quite atypical 
response for that group. Students and citizens and parents 
generally agree with the assertion. 



3. School personnel disagree more than the other two groups with 
assertion 15 (the OSPI is sensitive to state » regional » and 
local needs) and assertion 16 (the OSPI maintains effective 
contact with local » regional » and state agencies) though 
opinion is quite divided* 

4. Students express some disagreement with assertions 2 (the OSPI 
is flexible^ adaptive » and open)» S (the OSPI encourages new 
developments) t and 6 (the OSPI is humanistic) though the other 
groups agree with these assertions. 

When responses of all individuals are considered together » the following four 
qualities of the OSPI need most improvement: qtiality 13 (the OSPI has everyone's 
support); quality 16 (the OSPI maintains effective contact with local » regional » 
and state agencies); quality 1 (the OSPI is accountable to the citizens of the 
state); and quality 10 (the OSPI has sufficient financial support). 

Opinion about which qualities need Improvement the most varies substantially among 
the three groups. Students agree that assertion 13 (the OSPI has everyone's 
support) needs the most l]iq>rovement. However, they feel qualities 2 (the OSPI Is 
flexible* adaptive, and open), 5 (the OSPI encourages new developments), and 14 
(the OSPI has sound information basis for decision**maklng) also need more attention. 

School personnel wish the OSPI would become more sensitive to state, regional and 
local needs (assertion IS) more than anything else. They also feel qualities 2 
(the OSPI is flexible, adaptive, and open), 9 (the OSPI allows all people to 
participate In governance), 10 (the OSPI has sufficient financial support), and 
16 (the OSPI maintains effective contact with local, regional, and state agencies) 
particularly need Improveoient . 

Citizens and parents are 'most concerned with the 0SPI*8 becoming more accountable 
to the citizens of the state (quality 1). They also feel improvements are needed 
in quality 4 (the OSPI provides for equal educational opportunities); quality 8 
(the OSPI provides for continuous training and retraining of professional educators); 
quality 13 (the OSPI has everyone's support); and quality 16 (the OSPI maintains 
effective contact with local, regional, and state agencies). 

Purpose of Education . When responses of all respondents are considered together, 
there is no one main purpose of schools. There is a tie, essentially, between the 
knowledge and career purposes. Group variations in response are striking, however. 
Students decidedly prefer the human purpose of education; school personnel definitely 
prefer the knowledge purpose; citizens and parents clearly prefer the career purpose. 
All respondents feel it would be possible to accomplish all three purposes. 
However, school personnel are less optimistic about accomplishing the httman purpose 
than are the other groups (particularly the students) and they are more optimistic 
about achieving the knowledge purpose. 
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Technical Results 

General s Of all parts of the instrument, the •'money,'* "program," and "current 
status" sections are most vital; the "Importance" and "likelihood" sections are 
next; and the "general purpose" section is least vital to the total instrument. 
If the Instrument were to be used in abbreviated form, that order of priority 
would be suggested* 

The first problem with the existing Instrument is that many people did not know 
what the OSFI was. In the cover sheet for the Revised Instrument an explanatory 
sentence has been added. In addtion, many respondents were not able to differen- 
tiate between wh^t the OSPI should do and what local agencies should do in sections 
lA, IB, and IC. The Revised Instrument solves this problem by asking what goals 
"schools" should pursue. OSPI objectives will have to be inferred from responses 
to these statements. The tjrpical citizen cannot make such fine distinctions. 
Conforming to this change, the general-purpose-of -education section now succeeds 
the first three sections since they all ask questions about schools in general. 

The last two sections ask for opinions about OSPI programs and the OSPI itself. 
Since these programs and traits are more specific than statements in earlier 
sections of the instrument, some room is left for "No Opinion" if the respondents 
have no set feelings. It appears that school parsonnel have the most definite 
opinions about the OSPI so this may be the main group to analyze for this purpose. 

Parts IA> IBt IC . Part lA, which asks for the "Importance" on each of the basic 
goals, is the least differentiated of all the sections. Since these goals were 
preselected as important during the elaborate hearing process, it is not surprising 
that they are still seen as Important. In the Revised Instrument the scale 
headings have been changed in order to "stretch out" the responses and further 
differentiate among goals. The new headings become "Not Particularly Important," 
"Important," "Very Important," and "Absolutely Vital." The only other change is 
in Item 7. Since the term "world of work" means "effort" to some people, it was 
changed . 

Responses in Part IB nicely discriminated among the items and also contrasted with 
responses to items in Part lA. Some goals considered highly important were not 
seen as being feasible. Respondents had little trouble filling out the scale. 
However, there was some trouble analyzing it since some people marked right over 
the lines while others marked in between. One could analyze it with an overlay 
or convert it into a four«*column box scale like the others with similar labels 
for the boxes. We like It the way it is and prefer to put up with the scoring 
inconvenience. 

Responses In Part IC also discriminated nicely among the items and contrasted 
with responses in sections lA and IB. The goals respondents think important and 
feasible are not always th<*. ot^es on which they think the most money should be 
spent. Since respondents do respond differently to different scales, these findings 
Justify the Stake-Gooler maiel used to construct the instrument. 
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"The General Purpose of School/' originally the last part of the questionnaire, now 
becomes Part IV. It has undergone the most radical changes. As noted previously » 
it is the least vital section of the instruaentt it was not based on the Action 
Goals document, and in many ways it yiislds the least information. It does have 
value, however, so it has been retained with extensive modification. Mainly it 
was too long and wordy « The paragraphs have been cut to one sentence. The 
response statements have been shortened and now include more interesting rankings. 
The feasibility scales, which produced little data of interest, have been eliit- 
inated entirely. 

Parts II and III . The last two sections relate to the OSPI itself » as emphasized 
in their headings. The ''program" section, originally in Part II, was considered 
to be the most questionable before the field test. It was questionable for two 
reasons: pages and pages of programs in the Action Goals document had to be 
reduced to ten statements and the unusual "per cent'^of -effort assignment" scale 
v?as used. Gooler had had considerable trouble with respondents using this scale. 
However, the programs were intentionally divided into ten statements and it was 
suggested that respondents estimate in tens. The results were gratifying. The 
section produced some of the most Important results. 

Respondents had some difficulty understanding what some statements meant. In item 
9, for example, what are pupil services? But for the most part the problems were 
few. There were also relatively few complaints aboot the scale itself. The great 
advantages lie In the specificity. The items are actual OSPI programs, and the 
scale is a concrete assignment of effort that requires an adjustment of the other 
nine parts. The total effort must be distributed among all in a comparative 
sense. Bence» the findings are interesting. They show, for example, that students- 
rights programs are not greatly supported but that drug-abuse programs are. This 
does not mean that the OSPI should abandon the former and do the latter. But it 
is good data for consideration. This section is one of the strongest in the 
instriiment. 

The "Current Status" section also relates directly to the OSPI and also produced 
provocative information. l!i the Revised Instrument the "No Opinion" category is 
emphasised for those who do not feel sufficiently familiar with the OSPI to have 
an opinion. Since difficulties arose with a few terms like "humanistic" and 
"venture capital," these items were changed. Otherwise, the section remains the 
same since it seemed to work quite well in the field test. 

To reiterate, the most productive sections appear to be the money rating of goals > 
the effort allocation across programs, and the current status of the OSPI sections. 
An abbreviated form of the Instrument could be composed of these sections. 
However, there were no length problems at all with the original instrument and 
the general-^purpose^-of-education section has been greatly shortened. 



Suggest Ions for Use 

Revised Instrument 

WHICH EDUCATIONAL PRIORITIES FOR YOUR STATE? 

During 1971 the Office of the Superintendent of Public Instruction 
(the state agency In charge of administering programs In primary and secondary 
education) held a number of public hearings throughout Illinois to ask Its 
citizens what the future of education In the state should be. Many Ideas emerged 
from these hearings. Not aiX of them can be pursued with equal vigor » however, 
because resources are always limited. Your answers to the questions in this 
booklet will help tell us which ideas should be pursued the most and how OSPI 
can better help achieve them. This la an opportunity for you to have a direct 
influence on the education of the children in your state. 

To which group, or groups, do you belong? 

^ School Superintendent 

School Principal 

Teacher 
^^^^^^^^ Student 

School Board Membe* 

Parent of School Child 

Legislator 

Citixen 

Other 




-22- 



Goals 



!• How Important is it for the Schools to pursue these Reals? (Please 
indicate by checking one box in each row.) 



This is a goal which should be 

Itet partic- Important Very Absolutely 
ularly important vital 
important 

1. Students should master the I ' " ' j 
basic skills of readings 

communication 9 computation^ 
and problem solving 

2. SttKients should demonstrate ' " 
a positive attitude toward 

learning 



3. Students should demonstrate 
a feeling of adequacy and 

self -worth 



A. Students should be given 
the freedom to express the 
full extent of their 
creativity 

5. Students should acquire 
positive attitudes tot^ard 
persons and cultures 
different from their own 

6. Students should have equal 
educational opportunities 



7. Students should receive 
opportunity in training 
for a career 



8* Students should have 
experience in adapting 
to a changing i^rld 



9. Students should acquire 
habits and attitudes of 
gooc' citizenship 

ERLC 
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Xi. What Is the likelihood th4t each of these goals will be achieved? (Please 
indicate by placing an •'X^ along the line.) 



1_ 

None 



1 



1* Students should master the 
basic skills of reading » 
communication, computation, 
and problem solving 

2. Students should demonstrate 
a positive attitude toward 
learning 



3. Students should demonstrate 
a feeling of ade<iuacy and 
self -worth 

4. Students should be given 
the freedom to express the 
full extent of their 
creativity 

5. Students should acquire 
positive attitudes toward 
persons and cultures 
different from their own 



6. Students should have equal 
educational opportunities 



Students should receive 
opportunity in training 
for a career 



8. Students should have 
experience in adapting 
to a changing world 



9. Students should acquire 
habits and attitudes of 
good citizenship 



Not 
very 
likely 



Likely 



Highly 
Likely 



Certain 



1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


L ^ 


1 


1 


1 1 


1 i 1 i 1 


1 


1 


1 


1 1 


1 


1 


1 


1 


i 1 1 1 . 
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III. How much money should the schools spend on each of these goals? (Please 
indicate by checking one box in each row.) 



The schools should spend 



1* Students should master 
the basic skills of 
reading, communication » 
conq^utation, and problem 
solving* 

2. Students should demon- 
strate a positive atti*- 
tude toward learning 



3* Students should demon*- 
strate a feeling of 
adequacy and 8elf*-worth 

4* Students should be 
given the freedom to 
express the full extent 
of their creativity 



5* Students should acquire 
positive attitudes toward 
persons and cultures 
different from their own 



6. Students should have 
equal educational 
opportunities 



Quite a lot 
No money Little money of money 



As much money 
as possible 




7* Students should receive 
opportunity in training 
for a career 

8» Students should have 
experience in adapting 
to a changing world 



9* Students should acquire 
habits and attitudes of 
good citizenship 
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IV. The General Purpose of Schools 

Each of the three statements below has been offered as THE MIN PURPOSE 
of our schools. Please indicate your opinion on each purpose by ranking 
them in importance. Write the number 1 in the blank preceding the 
purpose you think is most important, the number 2 preceding the next 
most important purpose, and the number 3 preceding the least important 
purpose. 



RANK 
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The HUMAN Purpose of Education 

The main responsibility of the schools should be to examine 
what man is. What he has accomplished, and what he has 
failed to accomplish. 

The KNOWLEDGE Purpose of Education 

The main responsibility of the schools should be to help 
young men and women build skills for understanding — and 
even discovering'-^new knowledge. 

The CAREER Purpose of Education 

The main responsibility of the schools should be to prepare 
young people for their lifework. 
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ProRrams of the State Department of Education 

Below are the goals of programs that have actually begun. How much of the 
current total efforts of the Office of the Superintendent of Public Instruction 
should be expended on each one? (Roughly estimate percent of state effort, 
by tens if convenient*) 



% of Total Effort 

1* The assessment of student achievement, attitudes, 

and needs throughout the state. 

2. The provision of equal educational opportunities for 
all students regardless of their racial or cultural 
origins or handicaps by eliminating all patterns of 

segregation and by providing programs and services* 

3. Increased public participation in school decision- 
making throu^ public hearings, student representa- 
tion, appeal procedures, citizen advisory councils, 
etc* 



4* The reorganization of school districts so each 
district will have sufficient size and resources* 



5* The reorganization of pre-kindergarten education 
and individualized instruction In local schools* 



6* The incorporation of drug abuse education in local 
schools* 



7* The establishment of career education and adult 
education programs* 

8* The adjustment of professional preparation, certi- 
fication, and retraining procedures* 

9* The improvement of pupil services such as school 
counselors, psychologists, and social workers. 



10* 



The adoption of a statewide policy of student rights* 
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VI. Current Status of the State Departoent of Education 

A. In order to facilitate reaching these goals for the Staters children, 
the Office of the Superintendent of Public Instruction (OSPI) feels that 
it should possess certain qualities. These qualities are listed below. 
Please indicate the extent of your agrreeraent with the assertion that the 
Office of the Superintendent of Public Instruction now possesses each of 
these qualities. If you do not have an opinion^ mczrk. "No Opinion. " 



1. Is accountable to the citizens 
of the state 



Is flexible, adaptive, and 
open 



Is relevant for the times 



Provides for equal educational 
opportunity 



Encourages new developments 



6. Adapts to important changes 



7. Provides for continuous 
training and retraining of 
professional educators 

8. Allows all people to partici- 
pate in governance 



10. Has sufficient financial 
support 

11. Has qualified personnel 



Strongly No Strongly 

Disagree Disagree Opinion Agree Agree 
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11 » Has qualified leadership 



12. Has everyone's support 



13. Has sound information basis 
for decision-making 

1^* Is sensitive to state, 
regional and local needs 

15. Maintains effective contact 
with local, regional, and 
state agencies 

16. Encourages coordinated 
efforts among local, regional 
and state agencies 

17. Has sufficient funds to 
support Tie\7 educational 
practices 



Strongly No 
Disagree Disagree Opinion 



Agrea 



Strongly 
Agre e 



B. In which three of these seventeen qualities does the OSPI need most 
improvement? (Write the number of the Cjuality in the space below.) 

1. number 



2 . number 
3 • number 
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Procedures and Conditions of Use 

Ljmltations of the Instrument , The Instrument seems to be valid for what It 
attempts to measure; however. It has two important limitations. First, It does 
not allow for or measure the underlying current of hostility toward Institutions 
In general which was detected during personal Interviews. This hostility might 
be due to neo-popullst feelings. For example, one of the teacher negotiators said 
the Instrument did not deal with the most important Issues at all. Presumably 
these might Involve teacher-admlnlstrator*»cooinunlty relationships. Such latent 
hostilities could be recognized In many of the respondents, but we could not think 
of any goals or sections to add to the Instrument which would measure them. 

The best way to detect these underlying attitudes Is through lnf:ormal Interviews, 
since they are nebulous even in the minds of the respondents. Perhaps after a 
number of interviews a more formal approach could be determined. In that case, 
occasional interviews should supplement the administration of the instrument to 
pick up any domains missed by the questionnaire itself. In any case, interviews 
should be conducted since these attitudes are quite important and should not be 
neglected. 

Although the instrument is not valid for domains it does not cover, there is little 
question that it is more valid than most of Its kind. First, public hearings were 
held. Second, the hearings were summarized by a citizens group. Third, the 
instrument was constructed from the written document; and, fourth, the Instrument 
was tried out with known respondents. However » even this elaborate process does 
not mean all Important segments of public opinion are represented. 

It may be that many attitudes were not represented in the public hearings; that, 
like Wallace supporters, the witnesses could not express their precise feelings; 
or that the group drafting the document excluded many of the feelings. There is 
no way of telling why or exactly what Important domains of public feeling are 
missed by the instrument. However, this deficiency can be corrected by supple- 
menting the instrument with some Interviews. 

The second limitation of the instrument is related to the first limitation. Words 
like *'work" and 'Venture capital" do not mean the same thing to all social groups 
in this country. No doubt the goal expressions are strongly biased by the 
language of the highly educated. Both the citizen drafters of the doctment and 
the instrument developers represent this middle-class, educated bias. We know 
that it is there; we do not know how much it impedes communication. 

Analysis of Results . The substantive results in this report were derived from 
frequency distributions. There seemed to be little need to deal with an N of 
forty in a more elaborate manner. As can be seen, mich useful information can be 
gleaned this way. One can determine the most important items and least Important 
items in each section and compare items across groups. It is essential to compare 
at least three group8-*-students« school personnel, and citizens. Looking solely 
at total summaries destroys the object of investigating vanious publics. The most 
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important comparisons are among groups. Subgroups within these main categories, 
e.g., teachers and administrators, may also be worth exploring. Simple compar- 
isons may very well serve most purposes. We call this Level One analysis. 

Level Two analysis might involve more statistics, such as standard dcrriations 
and means. One might test for differences between groups using chi-fquares av.u 
test for differences across whole arrays of items using analysis of variance. 
Post hoc tests (e.g., the Scheffe) could det(>rmine which items are mdet different. 
One could also intercorrelate items to determine which items from different scales 
go together. For example, does the basic-skills goal go with the knowledge purpose 
of education or do people maintain those as independent categories in their nind? 
Naturally one would want to present the results of these analyses rather than the 
statistics themselves to the decision-makers. 

Level Three analysis is the most sophisticated. Factor analysis of the entire 
instrument would extend the item intercorrelation mentioned above. The data 
could probably be reduced to a few basic factors. Or a section like OSPI status 
could be factor-analyzed to reduce the number of items. Is there a "public 
support for OSPI" factor? If the emphasis is on the different perceptions various 
publics have of education in general or of the OSPI in particular, discriminant 
analysis would show ^jhich items maximally discriminate among the groups and what the 
basic dimensions of these differences are. The possibilities are many, but the 
basic analysis should probably occur at Level One. 

Uhat weights should be assigned the Importance, likelihood, and money criteria 
when applied to the same goals? There is no mechanical answer. Depending on 
one's purpose, one must weigh them intuitively. Should a goal with high importance, 
little money allocated, and low likelihood of achievement be pursued? This is 
where the judgment of the decision-maker must intervene. 

Sampling Procedures 

It is a well-established but little-publicized fact that "response error" overwhelms 
"sampling error." That is, a respondent misunderstanding an item or reading a 
wrong word causes much greater trouble than do Improperly drawn samples. Response 
error may run five to ten times that of sampling error. Reputable authorities 
have suggested for this project that questionnaires simply be handed out to anyone 
available and sampling error be ignored. That is, within groups like administrators 
one could simply hand out questionnaires at a convention and not be too far off* 
That would certainly be the easiest and lowest-cost procedure. 

Because of our knowledge of response erroir, this project concentrated on the 
validity of the Instrument, a much more luportant and seriously neglected factor. 
Nonetheless, there is a strong tradition among psychometric iane and sampling 
experts that sampling error be determlnecfl and reported in number form. Particularly 
if the data is highly publicized, some attention should be paid to sampling. Con- 
sequently, the sampling monitor for the National Assessment Project was consulted 
on this particular problem. 
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Flrst, It Is axiomatic Chat different publics be sampled. The basis of the whole 
plan Is that different groups will respond differently. In our field test we 
distinguished among school personnel, students, and parents and citizens. At 
least these distinctions should be isalntalned In any study. Further, we suggest 
that adxnl^tlstrators and teachers be handled as separate groups and* possibly, that 
citizens and parents be distinguished from one another. Legislators should be 
handled in an entirely separate manner specified latex. 

Three other stratifications might be useful: the six areas of the state, size of 
school district, and black-white or poor^not poor distinctions* It is important 
to note that the levels within strata may be Independent of one another. That is, 
one might divide the state into the six regions and sample blacks and whites in 
the Chicago regions while sampling within different size school districts in 
southern Illinois. Such sampling will greatly Increase the flexibility of the 
sampling design and greatly reduce sample sizes. Naturally though, such strata 
must be weighted in the total. 

Any of the survey organizations, such as National Opinion Research Corporation, 
University of Illinois Survey Research Laboratory, or others within the state, 
would have little difficulty in drawing such saiiq>les since population sizes are 
readily available for the groups. However, such precision will increase the cost 
of the survey many times over. 



Three Plans and Their Coat 

There are three major plans for using the instrument. Whi.ch plan is used depends 
on the use to which the data is to be put and the resources available. 

Plan A would permit the crudest kind of sampling procedure. The Instrument could 
be given to superintendents at conventions, teachers at meetings, mailed to citi- 
zens, given to students in schools, etc. There would be no attempt to sample 
across areas, etc. The only caution would be to get sizable samples of the primary 
publics. The data would be analyzed by Level One techniques. This plan would 
cost about fifteen thousand dollars per year and would be sufficient if the purpose 
is to inform OSPI management, the original Intent of this 6tddy. 

Plan B would subsume Plan A but: would Include occasional Interviews to probe 
beyond the instrument. Doing the interviews and interpreting them might raise the 
cost to between twenty and twenty-five thousand dollars* The data would still be 
used for management decision-making within the OSPI. 

Plan C would be necessary if the data were to be used publicly to defeM OSPI 
programs. Then the representativeness of the data would certainly be at issue. 
This would require a sophisticated sampling scheme of the type outlined in a 
previous section. Depending on how elaborate the scheme would be, the cost could 
run between fifty and one hundred thousand dollars. The data would have to be 
collected and analyzed within the subgroups determined by the scheme, thus driving 
costs up considerably. If the data were not to be used to publicly defend OSPI 
programs, these costs might seem exorbitant. Of course, these plans are not pure 
types and various combinations are possible. 
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One special exception Is noteworthy. Originally, legislators were to be Included 
as a respondent group. We now feel that they should always be Interviewed when 
filling out a questionnaire. The relatively small number of legislators Involved 
in educational affairs should not make interviewing too difficult if they are to 
be included as one group. 



Supplementary Approaches 

Besides the basic plans outlined above, a few other possibilities for further 
development might be kept in mind. One possibility lies in multidimensional 
scaling. Theoretically, one could present a group of legislators with a set of 
descriptions about the OSPI and through mathematical manipulation arrive at the 
bases on which they make their judgments. One could define the ^'Judgment space*' 
of every significant reference group and be able to predict how those groups 
would respond to various programs. The potential would be enormous. 

Unfortunately, this approach Is still potential. This study started off investi- 
gating multidinensional approaches and after some thought abandoned this approach 
as too impractical at the present time. This Judgment was later born out by a 
CIRCE graduate student who had great difficulties in his dissertation with a 
similar problem. 

Still in the future but considerably closer to reality is to use the University . 
of Illinois PLATO (Programmed Logic for Automated Teaching Operations) system. 
Perhaps the most sophisticated computer-teaching operation in the country, PLATO 
will have over four thousand terminals in operation all over the state within a 
few years. An instrument like the goal-priority one could be programmed into the 
control computer and great masses of data could be collected and reported quite 
cheaply. CIRCE is currently helping evaluate the PLATO operation « 

Most Immediately realizable is to supplement the instrument with some in-depth 
interviews of what people are thinking about education. These interview data 
could eventually be transformed into items on the goal instrument. The model 
would be the University of Michigan Consumer Survey. Even more practical would 
be to collect data and subject the instrument to further statistical investiga- 
tion—in other words, develop the instrimient further. 
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